🕷️️ Job Radar • SCRAPING

freelancer.com 2026-04-19 🟠

🔹 Real-time Data Aggregation from API & Social Media Endpoints
👤 Client: 🇺🇬 Kampala, Uganda Member since 2026-04-19
💰 Price: $20 Average bid
🚩 Problem: Need a system that fetches live data from an API and social media, then structures it for easy consumption.
📦 Existing: API access, social media endpoints.

Specifications:

[Target] Real-time or near real-time data collection
[Method] Python-based script with libraries like requests, praw (for Reddit), tweepy (for Twitter)
[UI/UX] Not applicable; CLI interface for running the script and viewing logs.
[Stack] Python 3.8+, requests, praw, tweepy, logging library, JSON output
[Security] Secure API keys and tokens stored in environment variables or a .env file
[Format] JSON output with structured data

Workflow:

1. Define the endpoints for both the API and social media platforms.
2. Implement functions to fetch text from the API and images from social media using appropriate libraries (requests, praw, tweepy).
3. Combine the fetched data into a single JSON object.
4. Store or output the combined JSON data.
5. Add error handling for rate limits, retries, and logging.